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STORAGE AREA NETWORK MONITOR DEVICE AND 
NETWORKED MONITOR SYSTEM 
By George Robert Parrett and James David Fainer 
BACKGROUND OF THE INVENTION 

5 Field of the Invention 

This invention relates to devices for testing and monitoring storage area networks (SAN), 
and in particular, to such monitor devices and a networked monitor system. 
Description of the Related Art 

Fibre Channel is a family of standards developed by the American National Standards 
y 10 Institute (ANSI) which defines a high speed communications interface for the transfer of large 
CO amounts of data between a variety of hardware systems such as personal computers, 

workstations, mainframes, supercomputers, storage devices and servers that have Fibre Channel 
^ interfaces. Fibre Channel provides a general transport vehicle for Upper Level Protocols (ULPs) 
\i such as Intelligent Peripheral Interface (IPI) and Small Computer System Interface (SCSI) 

% 15 command sets, the High-Performance Parallel Interface (HIPPI) data framing, Internet Protocol 
|n (IP ), IEEE 802.2, Asynchronous Transfer Mode (ATM), and the like. Compared to many other 

OS 

ffl interconnection systems for computer systems such as the SCSI bus, Fibre Channel can support a 

^ large number of devices ("nodes" or "links") with a large distance limit between nodes. Fibre 

{Ms 

Channel supports a matrix interconnection (a fabric) and a loop topology (Fibre Channel 
20 Arbitrated Loop, FCAL). Merging high-speed I/O and networking functionality into one 

connectivity technology, Fibre Channel provides a solution for high-speed data transfer and has 
been widely accepted in the computer industry, especially in client/server applications which 
demand high bandwidth and low latency I/O such as mass storage, medical and scientific 
imaging, multimedia communication, transaction processing, distributed computing and 
25 distributed database processing applications. 

Devices connected on the Fibre Channel must be examined from time to time to 
determine the performance, health and traffic of the Fibre Channel. Current methods for testing, 
monitoring and analyzing Fibre Channel devices employ dedicated computers, such as PCs, 
connected to the devices being analyzed. Commands and data are issued from the dedicated 
30 computer to the device being analyzed, and data are received and analyzed by the computer. 
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SUMMARY OF THE INVENTION 
The present invention provides method and apparatus for testing and monitoring a Fibre 
Channel link or links to determine the overall performance, health and traffic (data flow) of the 
fabric. 

5 An object of the present invention is to provide a more efficient method and apparatus for 

testing, monitoring and analyzing the performance of the Fibre Channel. 

Additional features and advantages of the invention will be set forth in the descriptions 
that follow and in part will be apparent from the description, or may be learned by practice of the 
invention. The objectives and other advantages of the invention will be realized and attained by 
10 the structure particularly pointed out in the written description and claims hereof as well as the 
appended drawings. 

To achieve these and other advantages and in accordance with the purpose of the present 
invention, as embodied and broadly described, the present invention provides a networked probe 
(or monitor) system for a Fibre Channel, the system including a plurality of Fibre Channel probe 

15 (or monitor) devices connected to the Fibre Channel and to a communications network, and a 
master connected to the communications network and communicating with the probe devices. 
The probe devices transmit information gathered from the Fibre Channel to the master via the 
communications network. In addition, the probe devices may be programmed by the master via 
the communications network. 

20 In another aspect, the present invention provides a probe for a Fibre Channel, the probe 

including a Fibre Channel interface for communicating with the Fibre Channel and a 
programmable logic block connected to the Fibre Channel interface and a communications 
network. The programmable logic block is programmed to perform all the monitoring functions 
of the probe, and may be programmable via software instructions received from the 

25 communications network. The probe devices may be portable and can be easily installed and 
removed from a Fibre Channel link. 

In another aspect, the present invention provides a probe attachment module attached to a 
switch device on the Fibre Channel to monitor a plurality of Fibre Channel devices connected to 
the switch. A multiplexer is provided in the attachment module to selectively connect one or 

30 more of the Fibre Channel devices to a probe contained in the module. 
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In yet another aspect, the present invention provides a method for monitoring a Fibre 
Channel. The method includes gathering information about the Fibre Channel using a plurality 
of probe devices connected to the Fibre Channel, communicating the gathered information to a 
master via a communications network, and processing the communicated information using the 
master. 

It is to be understood that both the foregoing general description and the following 
detailed description are exemplary and explanatory and are intended to provide further 
explanation of the invention as claimed. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 schematically illustrates a Fibre Channel topology with probe devices inserted 

into the fabric according to an embodiment of the present invention. 

Figure 2 shows a Fibre Channel probe device according to an embodiment of the present 

invention. 

Figure 3 schematically illustrates a Fibre Channel topology with probe attachment 
modules inserted into the fabric according to an embodiment of the present invention. 

Figure 4 shows a Fibre Channel probe attachment module according to an embodiment of 
the present invention. 

Figure 5 shows another Fibre Channel probe attachment module according to an 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
The preceding summary and the following detailed description are provided using the 
Fibre Channel as an example of a storage area network (SAN). The invention is applicable to 
other types of SANs as well, such as Gigabit Ethernet or Infiniband. The claimed invention is 
intended to cover all such applications. The implementation details may differ for different types 
of networks, but such detains are within the purview of those skilled in the relevant art and the 
invention can be practices based on the description herein and the general knowledge in the art 
without undue experimentation. The monitor devices described herein may be generally referred 
to as SAN monitors, or Fibre Channel monitors or Fibre Channel probes when used in the 
context of a Fibre Channel system. These terms are used interchangeably. 
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The present invention provides method and apparatus for monitoring and testing Fibre 
Channel devices (or more generally, SAN devices) to determine the overall performance, health 
and traffic (data flow) of the fabric. Fig. 1 illustrates a fabric 10 and a networked probe system 
according to an embodiment of the present invention. Here, the term "fabric" is used to 
5 generally refer to any Fibre Channel topology, including a fabric, a loop or a point to point 

topology. The fabric 10 includes, for example, a plurality of devices 12, Fibre Channel hubs 14, 
switches 16, and hosts 18 connected by the Fibre Channel 20 (shown as double lines in the 
figure). A plurality of Fibre Channel probes 22 are inserted into the fabric at various links as 
desired. The probes 22, as well as one or more masters 24, are connected to a communications 
10 network 26 (shown as single lines in the figure) such as an Ethernet. The master 24 may be any 
S tyP e of computer system, such as a PC, workstation, etc. Each Fibre Channel probe 22 is 

capable of performing one or more monitoring tasks in real time, including but not limited to: (1) 
111 Monitoring performance, health and traffic of the fabric; (2) analyzing specific transfers by 
fjj5 capturing all the data; and (3) generating traffic to test specific links. The Fibre Channel 
[w* 15 topology of Fig. 1 is exemplary only; the probes 22 may be used with any Fibre Channel 
; b topology. 

The probes 22 communicate with each other and with the master 24 using the 

£2 communications network 26, instead of the Fibre Channel 20. This may be referred to as out-of- 

iffl 

Q band communication. Preferably, the probes 22 operate in an unobtrusive "snoop mode" when 
20 gathering data from the Fibre Channel so as to minimize added latency to data transfer on the 

Fibre Channel. The probes 22 receive data from the Fibre Channel, partially process the data and 
transmit partially processed data (such as statistical information) to the master 24 via the 
communications network 26. The master 24 further processes the information and displays the 
results on a display system to be viewed by a user. The plurality of probes 22, in conjunction 
25 with the master 24, are therefore capable of providing a complete picture of the Fibre Channel 
network in real time. 

Generally, any suitable Fibre Channel probe devices capable of performing the above- 
described tasks may be used as the probe 22 in the topology of Fig. 1 . One such probe device 
according to an embodiment of the present invention is shown in Fig. 2. The probe 30 includes a 
30 Fibre Channel interface 32 for connecting to and communicating with the Fibre Channel 20, and 
a programmable logic block 34 adapted to be connected to the communications network 26. 
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Preferably, the probe 30 is a full duplex device capable of communicating with the Fibre 
Channel in both direction as well as communicating with the communications network in both 
directions. The Fibre Channel interface 32 is a device generally known in the field. The 
programmable logic block 34 is programmed to control all the monitoring functions of the probe 
5 30 by issuing commands to, transmitting data to, and/or receiving data from, the Fibre Channel 
through the interface 32, and communicating with the master or other Fibre Channel probe 
devices via the communications network 26. 

By employing programmable logic block 34, the probe 30 is flexible and can be 
programmed to performed any desirable monitoring tasks. In one embodiment, the 

10 programmable logic block 34 is dynamically configured by the user (such as a tester) through 
software instructions loaded from the master 24 via the communications network 26. Changes or 
improvements to the monitoring tasks can be added remotely without removing the probe 
devices from their attachment points in the fabric. This enables the user to dynamically specify 
the tasks performed by each probe in the Fibre Channel topology as needed. It also enables new 

15 configuration options to be added to the fabric as future needs arise. 

In another embodiment, the Fibre Channel interface 32 and the programmable logic block 
34 are contained in a housing to form an integral Fibre Channel probe unit. Such a unit may be a 
portable unit that can be easily installed in or removed from any Fibre Channel link as needed. 
Thus, a single portable device may be shared among multiple Fibre Channel devices and links, 

20 thereby reducing equipment cost. A combination of portable and non-portable probe devices 
may be used at various links of the fabric and connected to the same communications network. 

Although a programmable logic block 34 is employed in the probe 30 shown in Fig. 2, 
other hardware capable of performing control and data processing functions may be used, such 
as a hard-wired control logic, a processor or the like. 

25 Figs. 3 and 4 show an attachment module according to another embodiment of the 

present invention. Fig. 3 schematically illustrates an exemplary Fibre Channel fabric 40, which 
includes Fibre Channel devices 12, Fibre Channel hubs 14, switches 16, and hosts 18 connected 
to the Fibre Channel 20. The switch 16 is a known Fibre Channel switching device having a 
plurality of ports 16a to which a plurality of Fibre Channel devices 12 may be connected (see 

30 also Fig. 1). A probe attachment module 42 containing one or more probes is connected to the 
switch 16 at the ports 16a, as well as to the Fibre Channel devices 12 to be monitored. In 
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addition, the probe attachment module 42 is connected to a communications network 26 such as 
an Ethernet, to which other Fibre Channel probes and/or probe attachment modules as well as 
one or more masters 24 are also connected. The probe attachment module 42 is preferably 
attached to or mounted together with the switch 16. 
5 The probe attachment module 42 performs similar tasks as the probes 22 in the 

configuration of Fig. 1. These tasks include but are not limited to: (1) Monitoring performance, 
health and traffic of the fabric; (2) Analyzing specific transfers by capturing all the data; and (3) 
Generating traffic to test specific links. Similar to the configuration of Fig. 1, the probe 
attachment module 42 operates in an unobtrusive "snoop mode". The modules communicate 

10 with each other and the master 24 "out of band" using the communications network 26. A 
combination of probes and probe attachment modules may be used in conjunction with the 
master to provide a complete picture of the network in real time. 

Fig. 4 illustrates the structure of a probe attachment module that can be used in the 
configuration of Fig. 3. The probe attachment module 44 has a plurality of ports 44a adapted to 

15 be connected to the ports 16a of the switch 16, and a plurality of corresponding ports 44b 

adapted to be connected to Fibre Channel devices to be monitored. Each port 44b corresponds to 
a port 44a, and the pair of ports 44a and 44b are connected to each other and to a terminal 46a of 
a multiplexer 46. The multiplexer 46 selectively connects one or more terminals 46a to a Fibre 
Channel probe 48, which may be a similar device as the probe 30 shown in Fig. 2. Due to this 

20 configuration, a Fibre Channel device connected to a port 44b of the probe attachment module is 
connected to the switch 16 to allow normal performance of the switching function of the switch. 
In the mean time, the multiplexer 46 allows the probe 48 to be selectively connected to one or 
more of the Fibre Channel devices to perform the monitoring functions. The multiplexer 46 may 
be controlled by a scanner control (not shown in Fig. 4; see scanner control 58 shown in Fig. 5) 

25 to dynamically scan the ports 44b. Any desired scan patterns may be implemented to control the 
amount of time spent on each port 44b during a scan. For example, equal time may be allocated 
to each port, or the probe may be locked in and stay on certain ports. The probe 48, as well as 
the scanner control if present, is connected to the communication network and may be 
dynamically programmed to implement desired scan patterns and monitoring tasks. 

30 Fig. 5 illustrates the structure of another probe attachment module that can be used in the 

configuration of Fig. 3. Similar to the module 44 shown in Fig. 4, the probe attachment module 
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50 includes a plurality of ports 50a adapted to be connected to the ports 16a of the switch 16, and 
a plurality of corresponding ports 50b adapted to be connected to the Fibre Channel devices to be 
monitored. Two multiplexers 52 are provided, each connected to a respective Fibre Channel 
probe 54, and each port 50b is connected to either or both of the multiplexers. Preferably, the 
5 multiplexers 52 are controlled by a scanner control 58. Both the probes 54 and the scanner 
control 58 are connected to the communications network, preferably via a network 
communication hub 56. This allows the probes and the scanner control to be dynamically 
programmed to implement desired scan patterns and monitoring tasks. Although two 
multiplexers and two probes are illustrated in Fig. 5, any suitable number of multiplexers and 
10 probes may be provided. The probe attachment modules shown in Figs. 3 to 5 facilitate 

reduction of cost as the probes in the probe attachment module are shared by a plurality of Fibre 
Channel devices. 

Lfl In the structure shown in Figs. 4 and 5, the plurality of ports 44a and 44b (or 50a and 

j|; 50b) facilitate easy mounting or attachment of the module 44 (50) to an existing switch 16 in the 
fll 15 fabric. When installing the probe attachment module 44 (50), each port 44a (50a) is connected to 
/ a port 16a of the switch 16, and a Fibre Channel device that would be connected to a port 16a of 

ft! the switch 16 is now connected to a port 44b (50b) corresponding to the port 44a. Thus, the 
O probe attachment module 42 is easily attached to or mounted together with the switch 1 6. 
fi Alternatively, probe attachment module structures may be employed that do not use the pairs or 

^ 20 ports 44a/44b (50a/50b), so long as each Fibre Channel device to be monitored is connected to a 
terminal of the multiplexer 46 (52). The suitable connection configuration depends on the type 
of Fibre Channel device that the probe attachment module 44 (50) is attached to. Although a 
switch 16 is used as an example in the embodiments of Figs. 3 to 5, the probe attachment module 
may be attached to other Fibre Channel devices. The probe attachment module may also be used 
25 in a stand-alone configuration and not be attached to any existing Fibre Channel devices. While 
an existing device such as a switch provides a convenient attachment point for the probe 
attachment module, the monitoring functions of the module do not depend in any way on the 
device it is attached to. 

It will be apparent to those skilled in the art that various modifications and variations can 
30 be made in the Fibre Channel probe device or module and the networked probe system of the 
present invention without departing from the spirit or scope of the inventions. For example, the 
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invention is applicable to other types of storage area networks than Fibre Channel. As will be 
recognized by those skilled in the art, suitable changes would be necessary to apply the invention 
to other types of SANs. For example, the Fibre Channel interface would be replaced by other 
suitable SAN interface devices. Thus, it is intended that the present invention cover 
modifications and variations of this invention that come within the scope of the appended claims 
and their equivalents. 
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